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ABSTRACT 

The Exploration Systems Architecture defines missions that require rendezvous, proximity operations, and docking 
(RPOD) of two spacecraft both in Low Earth Orbit (LEO) and in Low Lunar Orbit (LLO). Uncrewed spacecraft must 
perform automated and/or autonomous rendezvous, proximity operations and docking operations (commonly known as 
Automated Rendezvous and Docking, (AR&D).) The crewed versions of the spacecraft may also perform AR&D, 
possibly with a different level of automation and/or autonomy, and must also provide the crew with relative navigation 
information for manual piloting. The capabilities of the RPOD sensors are critical to the success of the Exploration 
Program. NASA has the responsibility to determine whether the Crew Exploration Vehicle (CEV) contractor-proposed 
relative navigation sensor suite will meet the CEV requirements. The relatively low technology readiness of relative 
navigation sensors for AR&D has been carried as one of the CEV Projects top risks. The AR&D Sensor Technology 
Project seeks to reduce this risk by increasing technology maturation of selected relative navigation sensor technologies 
through testing and simulation, and to allow the CEV Project to assess the relative navigation sensors. 
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1. INTRODUCTION 

AR&D for the CEV requires a suite of relative navigation sensors that meet performance requirements and have 
operational characteristics and failure modes that are well understood. NASA has the responsibility to approve (or 
disapprove) the Contractor-proposed sensor suite. In order to do this, NASA will need to perform independent testing as 
early as possible in order to minimize cost and schedule impacts. 

The Exploration Systems Technology Development (ETDP) AR&D Sensor Technology Project has three major 
activities: the development of a relative navigation sensor database, relative navigation sensor testing, and relative 
navigation sensor modeling and simulation. The sensor database is used to capture sensor information and data. The 
sensor testing task allows NASA to obtain hands-on experience with the operational and performance characteristics of 
the sensors. The sensor modeling and simulation task provides a means by which to create and validate sensor models to 
be used in the design and development of the guidance, navigation, and control (GN&C) system. For the fiscal year (FY) 
2006 (FY06), the project applied these activities to a set of “pathfinder” sensors that were be used to be prepared for 
evaluation of the CEV Contractor-proposed sensors in late FY07. 

The AR&D Sensor Technology Project has three primary objectives related to the test planning and execution: 

1. To develop a comprehensive test plan for testing relative navigation sensors that the CEV Project can use as the 
basis for independent assessment and testing of CEV contractor-proposed relative navigation sensors. 

2. To execute the test plan to evaluate the selected relative navigation sensor technologies, as defined in this 
project, in order to understand the performance and operational characteristics. 

3. To use test results to develop a math model for each of the selected relative navigation sensors. 
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2. TEST ARTICLES 


This section describes the details of the four test articles. For FY06 testing, four test articles were selected as pathfinders 
to pave the way for testing CEV contractor-proposed sensors (or functional equivalents) in FY07. The team surveyed 
the sensors used in the Defense Advanced Research Project Agency’s Orbital Express (a satellite servicing and resupply 
technologies program) [1], Lockheed Martin’s Hubble Recovery Vehicle design, the United States Air Force Research 
Laboratory’s XSS-11 satellite system [2], and the NASA CEV reference design. The goal was to choose pathfinder 
sensors with the following attributes: 

1 . Representative of the types of sensors likely to be included in the CEV relative navigation sensor suite. 

2. Hardware and software domain expertise resident within the team. 

3. Hardware and software available with minimal acquisition cost to this project. 

4. Operational range within the FRL dimensions for final approach and docking. 

Four highly applicable candidate sensors were identified for the “pathfinder” activities: the Johnson Space Center’s 
(JSCs) Automatic Targeting and Reflective Alignment Concept (AutoTRAC) Computer Vision System (ACVS), a 
camera-based system that uses reflectors on the target vehicle; JSCs Natural Feature Image Recognition (NFIR), a 
camera-based system that does not require reflectors; Marshall Space Flight Center’s (MSFCs) Advanced Video 
Guidance Sensor (AVGS), a laser-based system that uses reflectors on the target vehicle; and the Optech LIDAR, a 
laser-based system that produces range and intensity data, provided by the Jet Propulsion Laboratory (JPL) for this task. 

2.1 AutoTRAC Computer Vision System (ACVS) 

The ACVS is a camera-based system that employs the use of light emitting diodes (LEDs) and specific targets composed 
of either mirrors or reflective surfaces to determine a relative state (range, azimuth, elevation, and roll, pitch, and yaw). 

The ACVS is composed of a charge-coupled device camera with LED array using a specific target. The operating 
principle is a 6-DOF pose based on a known target pattern. The first video frame is taken with LEDs on; the second 
video frame with LEDs off. The two frames are then subtracted from each other, eliminating the background while 
leaving the bright return from the retroreflectors. Standard image segmentation techniques are then used to determine 
the retroreflectors’ locations in the image. The correspondence between the potential target features (retroreflector 
blobs) and the known target model is then determined. Finally, a non-linear least-squares fit of the image data is done 
to determine the 6-DOF pose of the target object with respect to the camera. 

The ACVS capabilities vary based on the focal length of the camera lens selected and on the size of the ACVS target. 
Multiple ACVS targets are supported which would allow for reasonable pose results at long range using a large target, 
while using a smaller target at close range. The parameters shown in Table 1 are based on those used for the FRL 
docking target mockup tests - a single fixed 9mm lens, a 1024x768 imager, one long-range target (LRT) and one short- 
range target (SRT). This version of ACVS uses five retroreflectors for both the SRT and the LRT 


Table 1: ACVS Operational and Performance Parameters 


Field of View 

28 degrees horizontal x 21 degrees vertical -9mm lens 

Range 

0.75-40 meters. 

SRT: approximately 0.75-20 meters LRT: approximately 8-40 meters. 

Accuracy 

Predicted accuracies of 0.001 inch and 0.1 degree; operational 
expectation is 1 percent of range and 1 degree in pitch, yaw, and roll. 

Update rate 

15 Hz @ 30 hz frame rate 

Target angles 

LRT/SRT up to ±10 degrees 

Power consumption 

7.2 watts @ 18 Volts DC 

Mass 

0.45 kilograms each - sensor/LED and electronics box 

Dimensions 

12 x 10 x 10 centimeters sensor, 13x13x6 centimeters electronics 

Data interface 

IEEE 1394 from the ACVS camera to the data processing computer 


Failure modes and Fault Detection, Isolation and Recovery (FDIR) for the ACVS are the following: 

1. No pose determined due to too many potential target features (blobs/retros) or not enough targets features to match the 
target model. 




2. Pixel jitter, partial retroreflector-occlusion, or the retroreflectors sitting on the edge of the camera image frame can 
produce poor pose estimation - right pose, but slightly wrong values due to mis-determination of the true center of the 
target features. 

3. Internal software checks for matching retroreflector-design dimensions to the derived optical properties can cause 
rejection of a target feature (e.g. retroreflector blob not “round”). 

4. Least-squares- fit residuals of the pose must pass a static “goodness” limit before being marked as a valid pose. 

5. Imaging (brightness) of the target retroreflectors can be externally manipulated by manual control of the LED power 
input ( 10.0 Volts DC -> 18 Volts DC range) 

6. The software can adjust the camera exposure at each cycle based on pixel brightness value, to help achieve better 
retroreflector imaging. 

For data acquisition, camera images are sent to a personal computer (PC) where the images are processed in pairs to 
estimate the target’s 6 -DOF pose with respect to camera. There is no input requirement and the data output rate is a 
maximum of 15 Hz when using the PMA FRL test’s 1024x768 pixel cameras. A 60 Hz rate is available when using 
640x480 pixel cameras. 

Data output types include 4 timestamps in several formats (first frame start, second frame end, algorithm start, pose data 
output), pitch, yaw, roll, x, y, z, pose-fit, and then “blobs” data. “Blobs” are the individual retroreflector-retums as seen 
by the camera, and include size and location in the camera frame. Raw video data can be recorded, but the files will be 
rather large. 

The AC VS hardware and software components used for this test program are based on a 1997 development effort at 
JSC. The camera is a 2006 Point Grey 1024 x 768 black and white digital camera. The software has been updated during 
various development efforts over the last several years. 

2.2 Advanced Video Guidance Sensor (AVGS) Overview 

The AVGS is a video-based sensor that uses lasers to illuminate filtered retro-reflective targets. The operating principle 
is that the first picture is taken while the foreground laser illuminates the target, and the second picture taken while the 
background laser illuminates the target. The second picture is subtracted from the first picture and the remaining spots 
are matched to the target and used to compute relative position and attitude. 

The AVGS operational and performance parameters are shown in Table 2. 


Table 2: AVGS Operational and Performance Parameters 


Field of View 

16 x 16 degrees 

Range 

0.75-300 meters. 

The range for a short-range target (SRT) is 0.75-20 meters and 
a long range target (LRT) is 10-300 meters. 

Accuracy (at dock) 

±13 millimeters, ±0.3 degrees 

Update rate 

5 Hz and 25 Hz 

Target angles 

1 LRT up to ±27 degrees 
1 SRT up to ±12 degrees 

Power consumption 

20 watts 

Mass 

9.1 kilograms 

Dimensions 

30.5 x 25.4 x 17.8 centimeters 

Data interface 

RS-422 between the AVGS and the data acquisition computer 


Failure modes include the following: 

1 . Sun in the field of view (FOV) will generally cause a loss of tracking, but the sensor will recover automatically once 
the FOV is clear. 

2. If the entire target (either short-range target or long-range target) is not in the FOV, that target will not be recognized 
or tracked, but the sensor will keep attempting to acquire the target. 

3. Single-event-upsets can cause various problems. AVGS uses watchdog timers and other software and hardware error 
detection and correction methods. 




4. Failure of thermoelectric coolers can cause laser problems such as wavelength drift or overheating. Temperature 
sensors monitor various temperatures at 5 Hz. 

The AVGS is cabled to ground support equipment (GSE) with a laptop computer running software to command the 
AVGS and record data. The AVGS requires a seed range input of ±25 percent of the actual range to acquire the target. 
The data output rate is 5 Hz or 25 Hz 

Output of processed target data is range, azimuth, elevation, roll, pitch, and yaw, and the data is stored in a raw format 
along with the sensor’s health and status, range, azimuth, elevation, angle quaternion, and spot centroid information. 

The AVGS test article used for these tests was serial number 2 (SN2) from the DART program. SN2 was used to test 
the DART AVGS flight software and hardware and to support the testing of the Orbital Express AVGS. 

2.3 Optech LIDAR 

The Optech LIDAR is a pulsed LIDAR system (10 kHz) that is passively Q-switched to approximately 2 micro Joules 
per pulse. The operating principle is time-of-flight with a programmable scanner at 10 x 10 degrees. 

The Optech LIDAR was part of the United States Air Force Research Laboratory XSS-1 1 micro- satellite program [3]. 

The Optech LIDAR features are as shown in Table 3 


Table 1: Optech LIDAR Operational and Performance Parameters 


Field of regard 

10x10 degree field of regard 

Range to surface 

2 kilometer range to surface (albedo > 0.25) 

Range to retroreflector 

5+ kilometer range to 7millimeter retroreflector 

Output rate 

10 kHz samples - 1 10x10 scan per second 

Data interface 

RS-422 between the Optech LIDAR and the data acquisition 
computer 


Failure modes include the following: 

1. Scanner failure - Actuator failure (mechanical, electrical, or software) results in ranging still working and limited 
angular knowledge. 

2. Laser failure - Radiation or electrical failure results in loss of device. 

3. Receiver failure - Thermal or electrical failure results in loss of device. 

4. Software failure - Results in a fiducial false-positive or improper scanning. 

5. FDIR is via normal software fault protection. 

Data acquisition is accomplished by using a laptop to collect the LIDAR scans, each consisting of up to 10K angle, 
intensity, and range measurements. There are no input requirements and the data output rate is 1 megabit/second. 

The Optech LIDAR test article used for these tests is a prototype LR1 unit that was procured in 1998. 

2.4 Natural Feature Image Recognition (NFIR) Overview 

The NFIR is a model-based state estimation system that uses video images. The operating principle is to search the first 
image for the bounding box of the target vehicle, locate high-contrast target features, and match the target image features 
to the 3-D model and compute pose (position and orientation). The Kalman filter is used to estimate state (position, 
orientation and first-time derivative) from pose. 

The NFIR was tested using simulated video of the H-Il Transfer Vehicle (HTV) as seen from the exterior ISS camera 
during terminal approach: It was also tested using simulated video of the Hubble Space Telescope aft bulkhead during 
terminal approach. Pose estimation can use any high-contrast features on the target vehicle for which a 3-D model 
exists; no special targets are required. Accuracy from the test using simulated video of the HTV is as defined in Table 4 
below. 

The results in Table 4 apply from 260 meters to 65 meters with a 48 mm lens. Test accuracy improves from 65 meters to 
1 0 meters with 9 mm lens. The NFIR as used in the STP testing in the FRL utilized three cameras mounted side-by-side, 
each with a different focal length (25mm, 16mm, and 9mm). 




Table 2: NFIR Operational and Performance Parameters 


Range accuracy 

±3 percent of range with perfect camera calibration 

Range rate accuracy 

±0.06 m/sec 

Attitude accuracy 

±2 degrees 

Attitude rate accuracy 

±0.4 deg/sec 

Data output rate 

2 Hz 

Data interface 

! IEEE 1394b from the NFIR camera to the data acquisition computer 

Camera power (per camera) 

12 Volts DC, less than 2.0 amps via IEEE-1394 


Failure modes include the following: 

1 . The camera does not produce a useful image under these conditions: 

a* Scene brightness exceeds exposure control capability 
b. Hardware failure 

2. The image and 3-D model features of the target will be incorrectly matched if: 

a. The search area prediction was wrong due to an error in the previous pose 

b. The image motion of the features is larger than the search area 

3 . The computer fails 

4. The pose estimation fails because of a small number of features due to: 

a. Poor exposure 

b. Partial target vehicle occlusion 

c. Small target vehicle size in the image 

For data acquisition and control, the computer receives an image from the camera, computes the pose using image and 
internal camera calibration, estimates the state, and switches to the camera with the shorter focal length as the target gets 
closer (camera switching ranges were 10 m for the 25mm/16mm switch and 4 m for the 16mm/9mm switch). The start 
position and orientation of the target in world coordinates are required inputs to the sensor. 

The NFIR camera is a 2006 Point Grey 640 x 480 black and white digital camera. The software has been under 
development since 2003. 


3. TEST FACILITY 

MSFC’s Flight Robotics Laboratory (FRL) was developed to provide a single area in which avionics and robotic 
hardware and software could be tested in a full 6-degree-of-freedom (DOF) closed loop simulation. The FRL objective 
was to provide a full scale, integrated simulation capability for the support of the design, development, integration, 
validation, and operation of orbital space vehicle systems. The FRL is built on developed technologies such as air- 
bearing floors, servo driven overhead robotic simulators, precision targets, gimbals, 3 -DOF mobility units, and 
manipulator and visual system evaluation facilities. 

The FRL consists of two major testing facilities. The flat floor, a 13.41x 26.2 1-m (44 x 86-ft) precision air-bearing floor, 
the largest of its kind, which uses two self-contained mobility units called the Small Air Sled (SAS) and the Large Air 
Sled (LAS). Both units are capable of 3 -DOF motion and can be used to simulate docking between two separate 
spacecraft. An 8-DOF overhead gantry, called the Dynamic Overhead Target Simulator (DOTS), provides a 500-lb 
payload capability for simulating relative motion with respect to a fixed target on the facility floor,. A computer system 
provides inverse kinematics and allows the gantry to act as a target or as the 6-DOF rendezvous vehicle. A “jog” panel, 
located near the computer terminal, is used to switch the DOTS system into Manual Mode, Computer Mode, or Idle 
Mode. A DOTS panic button is located on the jog panel and main cutoff switches are located at strategic locations in the 
floor area. The DOTS has 8 DOF - bridge, trolley, waist, shoulder, extension, roll, yaw, and pitch. DOTS uses the 
SICK DMH 3000 rangefinders with an accuracy of +/- 5 mm and Stegmann Coretech CA25 rotary encoders with a 
repeatability of 0.005 degrees. The resolution at the end of the arm (cumulative through all the joints) is a translational 
combined error = 0.03 inch and a rotational combined error = .022 degrees. 

The test team evaluated the SAS and the DOTS systems and decided to use DOTS for open-loop testing in order to 
provide sensor characterization in the 6-DOF regime. An evaluation was made as to whether to mount the sensor or the 




target mockup on the DOTS gantry. There are three main reasons for mounting the target mockup on the moving DOTS 
platform and keeping the sensors on a fixed test stand: 

1. The Optech LIDAR is not eye safe, so safety for lab personnel can be better controlled if the L1DAR is in a fixed 
position. 

2. The Optech LIDAR in particular will be most sensitive to the vibration and flex of the moving DOTS platform, but 
other sensors will also be affected. 

3. It will be simpler to provide power and data interfaces to the sensors if they are on a fixed test stand instead of on 
DOTS. 

There are drawbacks to this configuration — there are some test conditions under which the DOTS motion is not able to 
replicate the more extreme dynamic angular rates of the target vehicle. Those tests were considered lower priority for 
this test program. 

The FRL also has a solar simulator that is mounted to a 2-DOF carriage with six 6-kVA lights. It operates independently 
of DOTS. Lighting is variable along the north track in an east-west direction and light pointing is available. 

3.1 Truth Data 

Truth data for the FRL trajectories are obtained with the use of a Leica Laser Tracker LTD800 with T-Probe/T-Cam 
accessories. Range and accuracy are as defined in Table 5. 


Table 3: Leica Laser Tracker Range and Accuracy 


3-DOF (LTD800 stand-alone) 

Maximum range 

40 meters 

Measurement 

accuracy 

0.001 inch 

6-DOF (LTD800 with the T-Probe) 

Maximum range 

15 meters 

Measurement 

accuracy 

15 micrometers ±6 
micrometers/meter 


The T-Probe is a small device that communicates with the laser tracker. The tracker collects the position (including 
orientation) of the T-Probe during testing. 

The T-Cam is a camera system that is located on top of the laser tracker. It tracks the T-Probe and determines its 
orientation through commands of light-emitting diodes on the body of the T-Probe. This sensor has a 15-meter range 
when used in a 6-DOF mode of operation. 

Also, during the 6-DOF mode of operation, the angular limitations are ±45 degrees of elevation (with respect to the 
tracker head) and ±45 degrees on the T-Probe (with respect to the T-Probe z-axis). 

Prior to testing, the laser tracker is configured to record data in the facility fixed frame BO. The sensor reference frame 
(the stationary frame under test) must be known with respect to the facility BO frame so that the relationship of the laser 
tracker position within that frame can be determined. The data collected will be the T-Probe position and orientation in 
the BO reference frame. The relationship of the target frame (D1 DOTS reference frame) to the T-Probe frame will be 
determined and used in post-processing to estimate the target frame position with respect to the sensor frame. 

Currently, the Leica stores data at a rate of 5 megabytes/hour when using a 25 -Hz sample. 

3.2 Test Facility Limitations 

The Leica laser truth system is 6-DOF for 15 meters. This requires that the trajectories be split up within 15-meter 
segments so that the truth sensor can be repositioned for different range segments. 

The DOTS encoder can provide truth data at a resolution of 0. 1 inch and 0.01 degrees. 




The blockhouse in the southwest comer may interfere with some trajectories. Pretest checkout of trajectories must be 
done to determine bad flight patterns. The checkouts will be accomplished with a desktop model of the safety and 
kinematic routines used by the real-time code. 

The FRL DOTS limits the azimuth and elevation angles. 

The maximum movement of the gantry (0.3 m/sec) is restricted to the following: 

1 . Maximum radial distance: 38 meters 

2. Maximum lateral distance: 13.3 meters 

3. Maximum up/down distance: 4.6 meters 

The maximum rotation of the gantry (1 deg/sec) is restricted to the following rotations: 

1 . Pitch: ±28 degrees 

2. Yaw: ±30 degrees 

3. Roll: 360 degrees 

4. TARGET VEHICLE DOCKING MOCKUP 

The design of the target vehicle docking mockup is an important component of this test program. Two docking systems 
are under consideration for the CEV: the Androgynous Peripheral Attachment System (APAS) and the Low Impact 
Docking System (LIDS). LIDS has been selected as the docking system for the CEV docking to the Lunar Surface 
Ascent Module (LSAM). As of the initiation of this test program, the Constellation Program has not decided whether the 
CEV will use APAS or LEDS when docking to the International Space Station. Because of the ambiguity, the project 
team decided to use a simple docking system representation that could be applicable to either docking system. 

For the three pathfinder sensors that will rely on retroreflectors (ACVS, AVGS and the Optech LIDAR), the shape and 
details of the docking system mockup are not important as long as the retroreflector placement is in a reasonably realistic 
geometric pattern. However, the NFIR system uses natural features of the target object. In order to create a simple but 
relevant target feature set, it was decided that the standoff cross target used for Shuttle docking to the ISS would be a 
good choice for short range and a docking ring the same size and shape of the APAS mechanism would be a good choice 
for long range. In addition, the NFIR software already included a model of the standoff cross target, so minimal software 
development was required. 

The resulting target mockup represents the general size and shape of the ISS PMA-2 tunnel and the APAS mechanism. 
Details such as hooks, wiring, and petals are not modeled. The mockup configuration was selected to be within the 
mounting requirements of the FRL DOTS 6-DOF gantry, meeting weight and clearance constraints. The reflector targets 
are placed around the perimeter of the mockup to minimize design changes to the sensors that use them (locations were 
not based on real CEV vehicle constraints). The white docking ring as shown was removed and integrated with the 
standoff cross target and the retroreflectors as shown in Figure 1. 



Figure 1: Target Vehicle Docking Mockup Mounted on the FRL DOTS 



5. TEST SETUP 


The test sensor was first mounted to a test stand within the FRL. The actual position was surveyed using a coordinate 
measuring machine (CMM). This CMM is a Leica LTD 800 and is used as a ‘truth measurement’ for evaluating the 
sensor performance. The LTD 800 is a 40-m laser tracker that uses an interferometer and absolute distance meter (ADM) 
to measure position of objects in space to within 0.1 mm. The Leica also uses a T-probe and a camera for 6 DOF 
measurements. The T-probe is a small active targeting device that provides attitude information within 15 meters. The 
camera is used to record LED’s on the T-probe for positioning information. The T-probe is limited to about +/- 45 
degrees during the 6DOF mode of operation. The Leica LTD 800, combined with the 6-DOF T-probe, provides relative 
range, bearing, and orientation. 

The sensor target was mounted onto the mockup on the DOTS as shown in Figure 2. The relationship, or vector, from 
the T-probe to the sensor target is developed, again with the Leica. Lastly, the Leica is surveyed into the facility (the B0 
frame) using know check points. So before any testing is started, the relationships between probe to sensor target, 
facility to sensor, and facility to Leica are established. The DOTS server provides a timestamp to the sensor controller 
and generates a TTL level pulse to trigger the Leica to record relative position and orientation for later comparison with 
sensor output. 



Figure 2: Leica CMM in foreground with DOTS mockup and Leica target mounted underneath 

Figure 3 is simplified diagram of the test setup. Since the Leica and test sensor don’t use the same target, the truth data 
must be transformed into a common frame for comparison. By simple vector addition, 

R SENSOR LEICA POSITION + ^ LEICA TARGET + ^TARGETS ^ 

The addition of the Leica position vector (measured real time during testing) to the Leica measurement of the sensor 
target from the t-probe location (fixed vector relationship) and the sensor to Leica recording frame (also fixed) is 
equivalent to the sensor to sensor target vector (Equation 1). During the test, the sensor records target position and the 
Leica records its own T-probe position. After the test, the data is post-processed with direction cosine transformation 
matrices to allow comparison of the Leica data to the test sensor coordinate frame. However, this simple model must be 
modified to allow for the robot arm movement. 

5.1 DOTS Vectors 

The DOTS uses its own encoders to ‘fly’ a closed loop trajectory. For these tests, the end of the mockup was defined to 
be coordinate frame Dl. A second frame (near the sensor position) was defined to be D2, which is simply a frame in 
space and not on any physical feature. Dl and D2 are defined so that the robot can move consistently and give a 
repeatable trajectory. The DOTS input file defining the trajectory is in the Dl to D2 frame. If the D2 frame was placed 
on the sensor, it would move from test to test because the each test sensor position within the facility is different. The 
actual end of robot arm (yet another coordinate frame B8) to the mockup frame (Dl) was determined by the Leica (note: 
DOTS records the encoders B8 tip motion in the B0 frame along with the B8 to B0 commanded tip position.) The Leica 
is placed in the facility frame (B0), so that its measurements are essentially B0 to Dl (which is the movement of the 
mockup within the facility). 



5.2 Final Analysis 

The DOTS encoders give a position and attitude as the robot moves- a B8 to D2 relationship. This is transformed to the 
D1 to D2 frame. The Leica gives the true measurement, a Leica (BO) to T-Probe relationship. This is also transformed 
to the D1D2 framework. The sensor to target frame is also transformed into the D1D2 framework. So there are now 3 
trajectories, sensor, Leica, and DOTS, which can be compared with one another. 

6, TEST TRAJECTORIES 

Many factors were considered in the development of the set of test trajectories. The approach was to identify a wide 
range of test conditions, available facilities, sensor-specific test parameters, test requirements for math model 
implementation, and CEV-type test conditions, and then to create a set of trajectories that represented the best 
combination of tests that could be conducted within the available project resources. The full test plan includes a 
complete list of test cases under consideration as well as a prioritization. 

The test plan was performed with the following limitations: 

The test plan was not designed to provide the full scope of tests required for verification testing because the requirements 
have not been derived against which verification testing would be performed. Additionally, the pathfinder sensor 
hardware does necessarily meet rigorous hardware and software standards. 

The test plan did not cover qualification testing; i.e., no flight-like hardware testing in most cases. 

Although the overall test range applicable for these tests is from 0 to 2000 meters, the testing focus is on close range 
(inside 40 meters) due to facility availability and resource limitations, and due to the fact that the final proximity 
operations and docking are the most critical. 

The test plan did not include specific characterization tests for evaluating radio frequency (RF) sensors. 



Figure 3: Model of Leica/Sensor Vectors 

There are four types of trajectories defined for this test program. The first is a set of trajectories for sensor 
characterization. These trajectories cover a wide range of radial distances and velocities, azimuth and elevation angles 
and angular rates, and vehicle angular rates. The second type is based on reference trajectories for the CEV provided by 
the CEV Flight Dynamics Orbit GN&C team. These trajectories cover approach and departure scenarios under varying 
dynamic conditions. The third type is a set of test cases designed to evaluate the effects of lighting conditions on the 
pathfinder sensors, two of which are particularly sensitive to lighting (ACVS and NF1R). The fourth type is a set of 
failure or extreme conditions, and includes trajectories to evaluate sensor performance in the presence of jet failure 










dynamic conditions, during close-in acquisition, with blockage, and with interference; e.g., multiple targets, light 
reflections, reflective materials. 

Due to the 15 m limit of the Leica truth sensor, all trajectories needed to be broken into segments of 1 5 m or shorter. The 
segments were designed to have some overlap. In addition, some of the trajectories were designed to be run the full 40 m 
length of the facility without the Leica truth data, in order to have continuity during some of the runs. 

The sensor characterization trajectories are a subset of a “Super Matrix” 4 that defines a large range of conditions that are 
not achievable within the scope of this project. There are two types of CEV trajectories: those broken into segments and 
those which span the full length of the FRL facility. 

7. TEST EXECUTION 

The AVGS unit was tested from 19 July through 04 August 2006. There were two days of sensor installation and 
calibration prior to the testing along with a Test Readiness Review (TRR) prior to the testing commenced (12 July 
2006). The AVGS testing required longer than anticipated calendar time due to a few issues: 1) DOTS trajectory 
violations, 2) Leica and T-probe placement optimization, 3) DOTS FRS overrun trouble shooting an debugging. A total 
of 89 trajectories were run for the testing. During the testing, the AVGS performed nominally with not unexpected 
results. There were roughly 14 FRS overruns and about 6 Leica outages during the testing. 

The AC VS unit was tested from 09 August through 18 August 2006. A Delta TRR was held on 07 August 2006 prior to 
testing commenced. No issues were raised during the Delta TRR. There were 8 FRS overruns and about 6 Leica outages 
that occurred during the 89 trajectories. There were 10 trajectories that were re-run during the course of the testing. 
During the testing, the AC VS real-time performance appeared to be nominal with no unexpected anomalies. 

The NFIR and LEDAR sensors were tested simultaneously due to several circumstances. The sensors were installed and 
calibrated during the second week of September (11 to 15 September 2006). The trajectory and testing was performed 
from 18 September through 26 September. NFIR testing was completed through this test duration. During the 89 
trajectories, there were 7 FRS overruns and approximately 5 Leica outages. There were 6 trajectories that were rerun due 
to either the FRS overruns or Leica outages. The LIDAR sensor was not tested completely due to man-power resources. 
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Figure 4: Comparison of sensor Radial (Range) measurement errors versus range for ACVS, AVGS, & NFIR 


8. TEST RESULTS 


Quick-look reports have been completed for all four pathfinder sensors, and a detailed analysis and test report has been 
completed or is nearing completion as of the writing of this paper. This section provides a high-level description of the 
performance for each sensor and a brief overview of lessons learned. Figure 4 above shows plots of the AVGS, ACVS, 
and NFIR sensor’s range error versus range for 5 m out to 15 m. 

Rofl Comparison of ACVS. AVGS. and NFIR Sensor Errors 



Figure 5: Roll error comparison for the ACVS, AVGS, and NFIR sensors. 


8.1 AVGS 

Detailed analysis of the results show that the AVGS performed well. The sensor always tracked the target, under any 
lighting conditions, when the target was completely within the sensor’s field-of-view. An analysis of 49 of the 
characterization trajectories as well as the CEV trajectories indicates that the AVGS data typically matches fairly closely 
with the Leica truth sensor data, with positions within 0 to 6 cm at ranges out to 30 meters and attitudes within 0.01 to 
0.25 degrees of truth. At ranges when both the short-range target and the long-range target were being tracked 
simultaneously, the long-range target data was generally more accurate and less noisy, as would be expected. These 
performance values are at the edge of or within the AVGS specification values. 

8.2 ACVS 

Performance of the ACVS sensor unit that was tested was within the predicted accuracies of one percent of range and 
one degree of attitude for most cases. The short-range ACVS target that was used, which has all five retroreflectors in 
the same plane, performed inadequately when target attitudes were close to a 0,0,0 orientation, as expected. For the 
long-range ACVS target, which has two of the five retroreflectors out of plane, the ACVS provided much better 
performance at the 0,0,0 attitudes and was less noisy overall, again, as expected. Misalignment of the ACVS sensor to 
the test targets has caused some interesting problems for the math model developers, which have since been successfully 
accounted for. ACVS performance with the solar simulator showed the same problems that are characteristic to most 
ten-year old video based sensors, including over/under exposure in dynamic lighting conditions (shadows, both in and 
out of direct sunlight), dynamic range of the imager, and image washout in direct sunlight. It should be noted that newer 
ACVS technology exists at a commercial vendor and may have software and hardware features that mitigate some of the 
problems encountered during this test program. 


8.3 NFIR 


For the sensor characterization trajectories and the typical CEV approach trajectories used in the test, NFIR generally 
tracked well with most position and attitude estimates falling within about 1% and 1 degree, respectively, of the truth as 
provided by the instrumentation in the test facility. Tracking failures occurred when: 1) the target moved too quickly 
from frame to frame, 2) the target moved out of the field-of-view, 3) the target was very dimly illuminated or 4) the solar 
simulator was in the field-of-view. Failure number one was remedied by post processing the recorded video of the target 
vehicle using all 15 frames/sec as opposed to real-time processing during the test of about 6 frames/sec. Blockage of 
part of the target vehicle, either by the edge of the FOV or by a blocking object located near the vehicle did not interfere 
with NFIR operation as long as enough features remained visible. 

8.4 OptechLIDAR 

The Optech LIDAR was tested in tandem with the NFIR sensor. Optech developed the sensor and data interface 
computer in response to a request for information (RFI) requesting a breadboard LIDAR for JPL’s Comet Sample 
Nucleolus Return in 1997. The breadboard device only allows for data storage of scan results, so all 6-DOF state 
determination is accomplished during post-processing. Limitations on the data storage computer and software result in a 
quadratically decreasing scan speed over the test duration (approximately 400 scans in a half-hour period) thus providing 
a relatively sparse time series for evaluation. Attitude determination data is noisy (as expected) due to the motion of the 
target during the 1 -second raster scan. Position determination, however, tracked quite closely with ground truth. 
Algorithms are being updated to compensate for the target motion during a scan period. The limited sensor field of 
regard (10x10 degrees) and the long delay between frames prevented 6-DOF estimation when fewer than 4 fiducials 
appeared in the scan. Overall, the device performed as expected generating very precise position information and 
orientation information consistent with the limitations associated with a scanning system. 

8.5 Lessons Learned 

This test program has provided many insights and lessons learned. A short list of lessons learned is provided below, and 
will be fully documented in a future test report: 

1. The development of relevant test trajectories that could fit within the limited resources and facility capabilities turned 
out to be more time-consuming than originally expected. 

2. The test participants found that the ability to precisely characterize the location and orientation of each test article, as 
well as the coordinate transformations required between the test article and target, had a significant impact on the test 
data evaluation process. 

3. Failure scenarios may not be applicable across all sensors, and the implementation of failure conditions requires 
adequate preparation and operations time in the schedule. 

4. Pre-test visits to the Flight Robotics Laboratory by sensor test personnel from other NASA Centers were very 
important for pre-test planning. 

5. It is important to allocate time margin in the test schedule for the “unknown unknowns.’" 

9. CONCLUSIONS 

The key result of this activity is the development a comprehensive six degree-of-freedom laboratory test program that 
will be applied during testing of CEV and other spacecraft sensors. Test plans, procedures, scripts, processes, and 
trajectories can be used for future tests. Additionally, participants acquired detailed knowledge about the test limitations 
and constraints for four specific sensor types. Follow-on work includes completion of the data analysis and test reports 
for each of the four sensors, as well as further testing in the second year of this project. 
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